Skip to content

feat(blob): support blob-view-field for cross-table blob reference re…#327

Merged
lszskye merged 5 commits into
alibaba:mainfrom
lszskye:add_blob_view_struct
Jun 3, 2026
Merged

feat(blob): support blob-view-field for cross-table blob reference re…#327
lszskye merged 5 commits into
alibaba:mainfrom
lszskye:add_blob_view_struct

Conversation

@lszskye

@lszskye lszskye commented Jun 1, 2026

Copy link
Copy Markdown
Collaborator

Purpose

Implements the blob-view-field feature, which allows a downstream table to store lightweight references (BlobViewStruct) pointing to blob data in upstream tables. At read time, these references are resolved back into BlobDescriptors by scanning the upstream table, enabling cross-table blob sharing without duplicating data.

Tests

  • blob_view_struct_test.cpp
  • blob_view_resolving_batch_reader_test.cpp:
  • blob_view_lookup_test.cpp
  • blob_table_inte_test.cpp

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Comment thread src/paimon/core/catalog/identifier.cpp
Comment thread src/paimon/common/data/blob_view_struct.h Outdated
Comment thread src/paimon/common/data/blob_view_struct_test.cpp
Comment thread src/paimon/common/reader/blob_view_resolving_batch_reader.cpp Outdated
Comment thread src/paimon/common/reader/blob_view_resolving_batch_reader_test.cpp Outdated
Comment thread src/paimon/core/catalog/identifier_test.cpp
Comment thread src/paimon/core/operation/data_evolution_split_read.cpp
Comment thread src/paimon/core/operation/data_evolution_split_read.h Outdated
Comment thread src/paimon/core/utils/blob_view_lookup.cpp
Comment thread src/paimon/core/utils/blob_view_lookup.cpp
Comment thread src/paimon/core/utils/blob_view_lookup.cpp Outdated
Comment thread src/paimon/core/utils/blob_view_lookup.cpp Outdated
Comment thread src/paimon/core/utils/blob_view_lookup_test.cpp

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@lxy-9602 lxy-9602 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@lszskye
lszskye merged commit 0da726b into alibaba:main Jun 3, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants